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1 Motivation 


The purpose of the Fluent Calculus is to solve not only the representational 
but also the inferential Frame Problem. While the former means the prob- 
lem of specifying all non-effects of actions, the latter concerns the problem 
of actually inferring these non-effects. When proving a theorem, values of 
fluents may be needed in situations other than the ones for which they are 
given or in which they arise as an effect of an action or event. Apparently, 
one-by-one and using separate instances of the relevant axioms, every such 
fluent value needs to be carried from the point of its appearance past each 
intermediate situation to the point of its use. This is done, for instance, 
in the Situation Calculus if successor state axioms are used, no matter 
whether reasoning is performed forward in time or via regression [17], and 
in the Event Calculus where persistence needs to be proven independently 
for each fluent value [18]. If all fluent values are needed in exactly the situ- 
ations in which they are given or arise, then the inferential Frame Problem 
causes no computational burden at all. The more fluents have to be car- 
ried unchanged through many intermediate situations or event occurrences, 
however, the more valuable can a solution to the inferential Frame Problem 
be. 

The Fluent Calculus, which roots in the logic programming formalism 
of [11], addresses the inferential Frame Problem by specifying the effect of 
actions in terms of how an action modifies a state. The application of a 
single state update axiom [23] always suffices to infer the entire change 
caused by the action in question. Central to the axiomatization technique of 
the Fluent Calculus is a function State(s) which relates a situation s to the 
state of the world in that situation. In turn, these world states are collections 
of fluents, which are reified to this end, i.e., treated as terms. That is to 
say, we use fluent terms like On(A, Table), where On is a binary function 
symbol.! Fluents that are known to hold in a state are joined together 
using the binary function symbol “o’ 
associative and commutative. It is illustratively written in infix notation. 


>. This function is assumed to be both 


Associativity allows us to omit parentheses in nested applications of o. 

As an example, suppose that about the initial situation So in some 
Blocks World scenario it is known that block A is on some block «, which 
in turn stands on the table, and that nothing is on top of block A or 
block B. Using the Fluent Calculus, this incomplete knowledge can be 
axiomatized by a first-order formula as follows: 


«,z[ State(So) = On(A, x) o On(a, Table) oz (1) 
A Vy, 2’ [2 # Only, A)oz’ Az Only, B)o z']] 


Put in words, of state State(So) it is known that for some « both On(A, x) 
and On(«, Table) are true and possibly some other fluents z hold, too— 
with the restriction that z does not include a fluent On(y, A) nor a fluent 
On(y, B), of which we know they are false for any y. This way of axioma- 
tizing negative information relies on a foundational theory of (in-)equality, 
the extended unique-name-assumption (see Section 3). 

Following [14], situations are essentially finite sequences of action per- 
formances. The function Do(a,s) denotes the situation which results from 
performing action a in situation s. State update axioms specify how the 
states at two consecutive situations are related. The universal form of these 

1 A word on the notation: Predicate and function symbols, including constants, start 


with a capital letter whereas variables are in lower case, sometimes with sub- or 
superscripts. Free variables in formulas are assumed universally quantified. 
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axioms is A(s) D I'[State(Do(a,s)), State(s)], where A(s) states condi- 
tions on s, or rather on the corresponding state, under which IT defines 
how the successor state State(Do(a,s)) is obtained by modifying the cur- 
rent state State(s). 

For example, suppose the effect of an action denoted by Move(u, v, w) 
is that the block u is moved away from the top of block v onto the top of 
block w. Let Poss(a,s) represent the property of action a being possible 
in situation s, then a suitable state update axiom for Move is, 


Poss( Move(u,v,w),s) D (2) 
State(Do(Move(u, v, w),s))°o On(u, v) = State(s) o On(u, w) 


That is, if Move(u,v,w) is possible in s, then the state after its perfor- 
mance plus On(u,v) equals the old state plus On(u,w). In other words, 
the only negative effect of this action is On(u,v) and the only positive 
effect is On(u, w). 

The preconditions of our action Move(u,v,w) are that the block to be 
relocated, u, is currently on v, that wf u, and that both uw and w are 
clear, 1.e., not obstructed by any other block. Formally, 


Poss(Move(u,v,w),s) = 


Holds(On(u,v),s)Aw#un (3) 
ade | Holds(On(a, u), 8) V Holds(On(«, w), s)] 


where Holds(f,s) abbreviates the equational formula dz. State(s) = f oz, 
indicating that f is contained in the state at situation s. 

Recall from above the partial initial specification given by formula (1), 
and suppose block A shall be moved away from its current location onto 
block B. Then the term State(So) in the instance {u/A, v/x, w/B,s/So} 
of state update axiom (2) can be replaced by a term which equals State(So) 
according to (1). So doing yields, after evaluating Poss(Move(A, x, B), So), 


dx, z[ State(Do(Move(A, «, B),Sp)) 0 On(A, a) = 
On(A, x) 0 On(x, Table) oz 0 On(A, B) 
A Vy, 2'.2 # On(y, A) ] 


The equation can be simplified thus: 


dx, z[ State(Do(Move(A, x, B),So)) = On(x, Table) oz 0 On(A, B) 
A Vy, 2/.2 € On(y, A)] 


We have now obtained from an incomplete initial specification a still par- 
tial description of the successor state, which in particular includes both the 
unaffected fluent On(a, Table) and the information that On(y, A) is false 
for all y. These two properties of the initial state thus survived the compu- 
tation of the effect of the action and so need not be carried over by separate 
applications of one or more axioms. 


An example reasoning problem 


Providing a solution to the inferential Frame Problem, the merits of state 
update axioms reveal when longer sequences of actions are considered. The 
planning problem sketched in Figure 1 is a simple example: Of the starting 
situation it is known that each block A; is on top of the corresponding 
block B; and that all blocks A; and C; are clear. The goal is to reshuffle 
the configuration so that each block A; is on the corresponding C;. 


183 


initial situation 


eS SSS SST 


goal situation 


Figure 1: A simple planning problem (with incomplete information). 


Let us first encode this planning problem by means of the Situation 
Calculus formalism of [14] (where fluents are not reified). Let On(t, v, 5) 
denote that block u is on v in situation s, then the partial knowledge of 
the initial situation is formalized as, 


On( A, By, So) A... A On(Ajo, Bro, So) A 


ade [| On(@, Ai, So) V...V On(x, Ain, So) V (4) 
On(x, Ch, So) V...v On(a, Co, So) | 


The goal is to reach a situation S which satisfies, 
On(A1, C1, S)A...A On(Aio, Cio, S) (5) 


Assuming that On is the only relevant fluent and Move(u,v,w) the only 
relevant action, a suitable effect specification is given by the successor state 
axiom, 


Poss(a,s) D 
On(u,w, Do(a,s)) = dv.a = Move(u,v, w) (6) 
V On(u,w,s) A Vo.a # Move(u, w, v) 


along with the precondition axiom, 


Poss( Move(u, v, w), ) 


On(u,v,s) Aw #u A 7dx[ On(a, u,s) V On(a, w, s)] (7) 


> Ill 


Now, a straightforward solution to the planning problem is to move in 
succession the blocks A,,...,A,9 away from their initial location onto 


blocks C,...,Cio, that is, 
S= Do( Move(Ato, Bro, Co), sey Do(Move(Ai, By, C1), So) o .) 


In order to formally verify that this action sequence is a solution, let UNA 
be a suitable collection of axioms expressing “uniqueness of names.” Then, 


{(6),(7)} U UNA —& (4) D (5). A proof of this theorem requires at least 
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190 instances of the successor state axiom, (6).? As many as 180 of these 
instances are used to conclude that some fluent is not changed by some 
action. 

The corresponding Fluent Calculus formalization of the planning prob- 
lem consists of the initial specification, 


dz [ State(So) = On(A1, Bi) o...0 On(Aio, Bio) oz A 
Va,2'[2 # On(a, Aj)oz' A...A 2 Onla, Aig) o2/ A (8) 
z# On(#,Ci)oz’ A...A 2 On(x, Cio) 0 2']] 


and the goal specification, 


z. State(S) = On(Ai,Ci)o...0 On(Aio, Cio) 0 z (9) 


As above, let S be the situation which corresponds to the plan of moving 
in succession the blocks A; from B; onto C;. Let W be the foundational 
axioms of the Fluent Calculus (see below), then a proof for the theorem, 
WU {(2),(3)} E (8) D (9) requires just 10 instances of the state update 
axiom, (2), one for each performed action. 

The computational value of the Fluent Calculus is crucially dependent 
on an efficient treatment of equality. While the simple addition of equality 
axioms may constitute a considerable handicap for theorem proving, a va- 
riety of efficient constraint solving algorithms have been developed for the 
particular equational theory needed for the function o (see, e.g., [16] for an 
overview), in particular for the restricted form of the unification problems 
which arise in the Fluent Calculus [9]. 


2 Fluent Calculus Signatures 


Fluent Calculus signatures can be considered reified versions of standard Sit- 
uation Calculus signatures ©, which are many-sorted first-order languages 
with equality which include the special sort sit for situations [14]. Some 
predicate symbols in ™ are fluent denotations; these are of arity > 1 with 
the last argument being of sort st. The corresponding Fluent Calculus 
signature is then obtained by 


1. replacing each n+ 1-place predicate symbol which denotes a fluent 
and whose argument is of sort sorts x sit by an n-place function 
symbol whose argument is of sort sorts; 


2. adding the binary function symbol “o” and the constant “§”, which 
serves as a unit element wrt. 0; 


3. adding asort fluent to which belong all well-sorted terms with leading 
function symbol obtained in step 1, and a sort state to which belong 
the constant @, each fluent, and each t,; ot where #;,¢2 are of sort 
state; 


4. adding the unary function State, whose argument is of sort szt. 


2 If n is the number of blocks of each kind A, B, and C, then n? instances 
are needed to keep track of the locations of the blocks A;. Moreover, each ac- 
tion Move(A;, B;,C;) has the preconditions of both A; and C; being clear in the 
situation Do(Move(Aj-1, Bi-1, Ci-1),..., Do(Move(A1, Bi, C1), S0)...), which re- 
quires a total of 2-[(n-—1)+(n—2)+...+1] = n-(n—1) additional instances of 
the successor state axiom. 
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Fluent Calculus signatures for domains which require a solution to the 
Ramification Problem include, 


5. the unary function “—” whose argument is of sort fluent, and the 


sort effects to which belong the constant §, each fluent, each term 
—f where f is a fluent, and each t; of: where t,,t2 are of sort 
effects; 


6. the predicate Causes of sort state x effects x state x effects and the 
predicate Ramify of sort state x effects x state. 


The meaning and use of this addition will be explained in Section 4.3. 
Fluent Calculus signatures for domains which require to reason about 
the consumption and production of resources include, 


7. the sort resource such that each resource belongs to the sorts state 
and effects, which are extended accordingly, and such that the domain 
of function “—” of item 5 above extends to terms of sort resource. 

The use of this addition will be explained in Section 5. 

In the remainder of this paper, variables of sort sit will be denoted by 
the letter s, variables of sort fluent by f, variables of sort state by z, 
variables of sort effects by e, and variables of sort resource by r, all 
possibly with sub- or superscripts. 


3 Foundational Axioms 


Fundamental for any Fluent Calculus axiomatization is the axiom set EUNA 
(the extended unique-name-assumptions). Its definition relies on a complete 
AC 1-unification algorithm, 1.e., a unification procedure by which are com- 
puted complete sets of most general unifiers wrt. the equational theory of 
associativity, commutativity, and existence of a unit element (see, e.g., [4]). 
Set EUNA comprises the following equational axioms [12]. 


1. The axioms AC1 for o and 9, 


(21029) 023 = 21 0(29 0 23) 
£1 OZ = 290 24 
zo = z 


All variables are universally quantified. 


2. For any two terms t; and ty of sort other than state or effects and 
with variables 2, 


(a) if t; and ta are not unifiable, then 


ad#. ty = te 


(b) if t; and te are unifiable with mgu @, then 


Vi [t, =te >) Ay. b= | 


where 7 denotes the variables which occur in = but not in #2 


3 By @= we denote the equational formula 21 = 71 A...A@n = fn constructed from 
the substitution 6 = {7,  1r1,...,2n Tn}. 
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3. For any two terms t, and ty of sort state or effects and with vari- 
ables # and such that function State does not occur in ¢, nor in te, 


(a) if t; and ty are not AC1-unifiable, then 


ad#. ty = te 


(b) if t; and t, are AC1-unifiable with the complete set of unifiers 
Unca(t, ta), then 


V@ | tl =te Dd VV 37. 0= 
6€cU gci(41,t2) 


where y denotes the variables which occur in @~ but not in 2. 


The axioms of item 3, in conjunction with the standard uniqueness of names- 
assumption in item 2, ensure that EUNA is unification complete [13, 19] 
wrt. state terms and the equational theory AC1. These axioms entail in- 
equality of two state terms (or effect terms, resp.) whenever these are 
composed of different fluent terms. 

The assertion that some fluent f holds (resp. does not hold) in some 
situation s is formalized as dz. State(s) = foz (resp. Vz. State(s) # foz). 
This allows to introduce the common Holds predicate, though not as part 
of the signature but as a mere abbreviation for a certain equality sentence: 


Holds(f,s) dt ay, State(s) = foz (10) 


Then any Situation Calculus assertion about situations can be easily trans- 
ferred to the Fluent Calculus; for example, the Situation Calculus formu- 
la On(A, Table, So) V Ve. nOn(x, B, So) reads Holds(On(A, Table), So) V 
Ve. Holds(On(«, B), So) in the Fluent Calculus. 

Finally it needs to be guaranteed that state terms do not contain any 
fluent twice or more, that is, 


Vs, f,2. State(s) # fofoz (11) 


(It will be explained shortly why o is not required to be idempotent to this 
end.) 


4 State Update Axioms 


The schema A(s) D ['[State(Do(A, s)), State(s)] is the universal form of a 
state update axiom. Typically, condition A(s) combines atom Poss(A, s) 
with a formula consisting of Holds(f,s) atoms. The form of the update 
component I itself depends on the ontological assumptions that can be 
made of the action in question. We will discuss three cases in turn. 


4.1 The Simple Case 


Deterministic actions with only direct and closed effects give rise to the 
simplest form of state update axioms, where I is a mere equation relating 
State(Do(A,s)) to State(s). By closed effects we mean that an action does 
not have an unbounded number of effects. Suppose action a has a positive 
effect f, then this fluent simply needs to be coupled onto the old state 
term via State(Do(a,s)) = State(s)o f. If action a has a negative effect, 
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then the fluent f which becomes false needs to be withdrawn from the 
old state. The scheme State(Do(a,s))o f = State(s) serves this purpose.* 
The combination of these two schemes constitutes the general form of state 
update axioms for deterministic actions with only direct effects: 


A(s) D State(Do(a,s))o 07 = State(s) o vt 


where WY are the negative effects and Jt the positive effects, resp., of 
action a under condition A(s). The perfect symmetry of the equation 
in the consequent allows using a state update axiom equally for reasoning 
forward and backward in time. 

State update axiom (2) for the Move action belongs to the simple case; 
here are two more self-explanatory examples: 


Poss(Shoot(a, y), 8) A Holds( Loaded(x), 8) A aHolds( Dead(y), 8) D 
State(Do(Shoot(a, y), 8)) o Loaded(x) = State(s) o Dead(y) 


Poss( Walk(r, x,y), 8) A Holds( Time(t), s) D 
State(Do( Walk(r, x,y), 8)) 0 At(r,x)o Time(t) = 
State(s) o At(r,y) o Time(t + Pistancels.y) ) 


Velocity(r) 

Under the provision that actions do have only direct and closed effects, 
simple state update axioms can be fully mechanically generated from a set 
of Situation Calculus-style effect axioms if the latter can be assumed to give 
a complete account of the relevant effects of an action. For example, our 
state update axiom (2) for the Move action would result from applying 
this construction to the two effect axioms, 


Poss( Move(u,v,w),s) D Holds(u,w, Do( Move(u, v, w), s)) 
Poss( Move(u, v, w),s) D> aHolds(u, v, Do( Move(u, v, w), s)) 


It has been proved that a collection of thus generated state update axioms 
suitably reflects the basic assumption of persistence. This is the primary 
theorem of the Fluent Calculus [23]. 


4.2 Disjunctive State Update Axioms 


Nondeterministic actions are very elegantly specified by means of disjunc- 
tive state update axioms A(s) D [[State(Do(a, s)), State(s)], where T is 
a disjunction of the possible effects, i.e., state updates, of the respective 
action. The following, for instance, specifies the alternative outcomes when 
performing the Russian roulette-like spinning of the chamber of a loaded 
gun 2: 


Poss(Spin(x), s) A Holds( Loaded(x),s) D 
State(Do(Spin(x), s)) o Loaded(a) = State(s) 
V 
State(Do(Spin(x), s)) = State(s) 


That is, fluent Loaded(a) may or may not become false when performing 
the action Spin(«). 


* This scheme is the sole reason for not stipulating that o be idempotent, contrary 
to what one might intuitively expect. For if the function were idempotent, then 
the equation State(Do(a,s)) o f = State(s) would be satisfied if State(Do(a,s)) 
contained f. Hence this equation would not guarantee that f become false. 
Foundational axiom (11), too, is vital for this scheme since without it the for- 
mula State(Do(a,s))o f = State(s) again would not entail 4Holds(f,Do(a,s)) 
as State(s) could possibly be fo f. 
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4.3. State Update Axioms with Ramifications 


The Ramification Problem [7] denotes the problem of handling indirect ef- 
fects of actions. These effects are not explicitly represented in action speci- 
fications but follow from general laws, so-called state constraints, describing 
dependencies among fluents. An example is the extension of the Yale Shoot- 
ing domain [10] by the state constraint, 


Holds( Walking(y), 8) > 1Holds( Dead(y), s) (12) 


which is meant to formalize the fact that in all situations all walking things 
are not dead. As argued in [1], this state constraint gives rise, for instance, 
to the indirect effect that a turkey stops walking as soon as it is shot. More 
precisely, if both Walking( Turkey) and 4Dead( Turkey) happen to be true 
when an action is performed which causes Dead( Turkey), then this action 
additionally causes 4 Walking( Turkey). 

Such further, indirect effects can be accounted for with the help of causal 
relationships [20, 21]. Each of them defines circumstances under which a 
single indirect effect is to be expected. A successor state is then the result 
of applying a chain of causal relationships, after having computed the direct 
effects of an action. 

Let Causes(z,e,z',e’) denote that in the current state z the occurred 
effects e give rise to an additional effect, resulting in the updated state 2’ 
and the updated current effects e’. For instance, the (only) kind of indirect 
effects in our example is accommodated via the following definition: 


Causes(z,e,2',e') = dz.e = Dead(y)oz A 
z' o Walking(y) = z A (13) 
e' = e0 —Walking(y) 


where a sub-term —F represents the occurrence of a negative effect. Put 
in words, if Dead(y) occurs as (direct or indirect) effect, then this causes 
Walking(y) to become false, in z’, as indirect effect, which also yields 
an extended collection of current effects, e’. From (13) we can derive, 
for instance, that whenever the turkey is dead but still walking after an 
action has occurred with the effects —Loaded(Gun) and Dead( Turkey), 


then —Walking( Turkey) is additionally caused; that is, formally, 


Causes( Dead( Turkey) 0 Walking( Turkey) o 2, 
—Loaded( Gun) o Dead( Turkey), 
Dead( Turkey) 0 2, 
—Loaded(Gun) o Dead( Turkey) o —Walking( Turkey)) 


State update axioms which account for indirect effects are of the form, 


A(s) D 
zov” = State(s)ovt D (14) 
Ramify(z, -07 o UT, State(Do(a, s))) 
where 
ev? are the direct negative effects; 


e Jt are the direct positive effects; 


e Ramify(z,¢, Znew) means that state zpey is reachable by successively 
applying (zero or more) causal relationships to state z and effects e. 
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Usually, most states zpey, which are reachable from z,e violate the under- 
lying state constraints and, hence, can only be intermediate states on the 
way to a possible successor state: Schema (14) says that we are interested 
in reaching a state which can be assigned to the expression State(Do(a, s)), 
hence which satisfies all constraints (c.f. (12), e.g., which quantifies over all 
situations and therefore applies to all states assigned to a situation). 

The definition of predicate Ramify requires a standard second-order 
axiom to characterize the reflexive and transitive closure of Causes: 


Ramify(z,€, Znew) = 
Veq, €1. T(z, €1,71, €1) 
A 
Veq, €1, 22, €2, £3, €3. 
II (21, €1, 22, €2) A Causes(z2, €2, 23,€3) D (21, €1, 23, €3) 
>) 
Fenew. (2, €, news Enew) 
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Along with the axioms above and the foundational axioms of the basic 
Fluent Calculus, this state update axiom, 


Poss(Shoot(a, y), 8) A Holds( Loaded(x), 8) A aHolds( Dead(y), 8) D 
zo Loaded(x) = State(s) o Dead(y) D 
Ramify(z, —Loaded(x) o Dead(y), State(Do(Shoot(a, y),s))) 


entails that Holds(Loaded(Gun), So) > aHolds( Walking( Turkey), Si), with 
S = Do(Shoot(Gun, Turkey), So)). 


5 Reasoning about Resources 


The Fluent Calculus offers a most natural way of reasoning about the dy- 
namic production and consumption of resources. This feature is rooted 
in the non-idempotency of the connection function o, which implies that 
EUNA entails t; # tg whenever any sub-term which is not the unit ele- 
ment @ occurs a different number of times in t; than in ty. State con- 
stituents may thus not only represent fluents but also resources, for which 
the number of occurrences matters. The following, for example, holds true 


under EUNA: 
Wheel(d, x) o Wheel(d, x) 0 Acle(l, y) 4 Wheel(d, x) o Azle(l, y) o Aale(l, y) 


This inequation can be read as, having available two wheels (with identical 
diameter d and ahole of diameter x in the center) and one axle (of length / 
and diameter y) is different from having available just one such wheel but 
two axles. 

The reader may recall foundational axiom (11), by which state terms 
associated to situations are required to contain at most one occurrence of a 
fluent. Neither this nor a similar restriction applies to resources. 

As an example, let Wheel(d,x), Arle(l,y), and Chassis(l,d) be of sort 
resource. Then the following formula states the initial availability of at 
least two axles of length 3.5’ and the availability of exactly three wheels of 
identical diameter such that the two axles fit into the center holes of the 
wheels: 


dd, x, z[ State(So) = Arle(3.5’, a) o Arle(3.5’, x) 0 
Wheel(d, x) 0 Wheel(d,x)o Wheel(d, x) 0 z 
AMVd',@',2'.2# Wheel(d’, x’) 0 2] 
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Consider the action of assembling a two-wheel chassis of width 7 and di- 
ameter d, denoted by Assemble(l,d). This action is possible iff two wheels 
of diameter d and a fitting axle of length / are available: 


Poss(Assemble(l, d),s) = 
dx. Holds( Wheel(d, x) o Wheel(d, x) o Aale(l, x), s) 


In this formula we have employed a generalization of the Holds macro 
(c.f. formula (10)) which allows the first argument to be of sort state: 


Holds(z1, 8) def 3, State(s) = 2102 


The effect of assembling a chassis is that two wheels and one axle are 
‘consumed’ and a corresponding chassis is produced. Formally, 


Poss(Assemble(l, d),s) D 
dx. State( Do( Assemble(l, d),s))o 
Wheel(d, x) 0 Wheel(d,x) 0 Arle(l, x) = State(s) o Chassis(l, d) 


The axioms of this section along with the foundational axioms of the 
Fluent Calculus entail, for instance, that in the initial situation it is possible 
to assemble one chassis but—due to the limited supply of wheels—not more: 


dd. Poss( Assemble(3.5’, d), So) A 
dl, d. Poss( Assemble(1, d), Do(Assemble(1, d), So)) 


6 Historical and Bibliographical Remarks 


The Fluent Calculus roots in the equational logic programming formalism 
of [11], which introduced the binary connection function “o” along with the 
principle of modeling change as rewriting collections of fluent terms. The 
monograph [22] contains a detailed biographical account of the research 
based on the principles which underlie the Fluent Calculus. Most notably, 
in [8] the original formalism was proved to be closely related to earlier ap- 
proaches to the Frame Problem which appeal to non-classical logics, namely, 
linearized versions of the connection method [2] (now also known as Transi- 
tion Logic [3]) and of Gentzen’s sequent calculus [15], both of which embed 
into a logical framework the operational STRIPS approach [5]. A detailed 
account of these two formalisms, including a number of further comparison 
results, is given in the monograph [6]. 
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